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ON  INDEPENDENT  SAMPLES  FROM  NORMAL  POPULATIONS 

by 

A.  A.  Zinger 

It  is  well  known  that  for  a sample  from  a normal  pop- 

. „ 2 
illation,  the  sample  mean  x and  the  sample  variance  s are 

independent.  This  theorem  was  proven  by  R.A.  Fisher, 

The  question  arises:  To  what  extent  does  this  property  (the 

independence  of  x amd  s^)  characterize  a general  population? 
Here  we  must  point  out  the  work  of  Lukacs  where  it  is  proven 
that  if  the  general  population  has  a moment  of  the  second 
order,  and  if  the  sample  mean  and  sample  variance  are  independ 
ent  in  samples  of  si&e  n > 1,  then  the  general  population  is 
distributed  normally.  However,  this  theorem  does  not  answer 
completely  the  stated  question,  since  the  condition  demanding 
the  existence  of  a general  second  moment  imposes  a considerabl 
limitation.,  There  remains  the  question  of  what  the  general 
distribution  might  be  if  we  do  not  demand  a priori  the  ex- 
istence of  a general  second  moment, 

THEOREM » Let  us  consider  n (n>l)  mutually  independent 

random  variables  x,  « x_,  ....  x , each  of  which  is  distributed 

1 2 n ' 

according  to  the  law  F(x).  Let  us  w-  x = (x^+x^+.o*  +xn)/n 
P 2 2 

and  sd  = [ (x^-x)  +.„«  + (x^-xf  1 /n.  If  x and  s^  are  independent 
then  the  distribution  F(x)  is  normal. 


£ 


Proof*  We  note  first  the  obvious  algebraic  identity 

• ^ 2 2 p 

2 x . = nx  + ns^  (1) 

j=i  - 

and  introduce  the  function  f(t): 

f(t)  = E(eltx~x  ) (2) 

The  symbol  E here,  and  elsewhere,  denotes  the  mathematical 
expectation  of  the  random  variable  within  the  parentheses. 

Let  us  note,  that  due  to  the  finiteness  of  the  integrals 

+ 00  2 

J xne“x  dp(x)  (3) 

-00 


the  function  f(t)  is  differentiable  any  number  of  times.  To 
prove  the  theorem,  it  is  necessary  that  f(t)  be  differentiable 
only  twice. 

Examine  the  expression 


E f ns2  exp [ 2 (itx.-x^)]}  * (II) 

j=l  J 3 

p 

Making  use  of  the  independence  of  x and  s and  the  x- -•  ntity 

(1),  let  us  write 


E{ns2exp[  2 (itx.-x?)]}  = E(ns2e“ns  )E[exp(it2Xi  -nx'1' ) ] 

J=1  J J 1 

Let  us  transform  separately  both  sides  of  (5>)  : 

o ^c,2  n _ 2 -ns2,,  n 

E(ns‘-e“  )E [ exp ( it  Si  x .-nx2)  ] = Ejris — 'E[exp(it  2xr 

j~l  3 E(e“ns2)  j=lJ 


nx2 ) ]E  ( 


(5) 

2 

e~ns  ) 


(6) 
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Again  using  the  fact  that  x and  sr~  are  independent,  we  write 

.2  n o n 


E(ns2e  LS  ) E[exp(it  2 xrnxL)]  = aE{exp[  2 (itx  . - x*T  ]}  (7  ) 

J=1  J 3=1  J J 


where  we  define 


a 


„ / 2 -ns  \ 

Elns^e  ) 


E(e"nS  ) 


(8) 


Furthermore,  since  all  x^  are  by  definition  mutually  independent 
and  since  each  is  distributed  by  the  law  of  F(x), 


n 


Efexpt  2 (itx*-x23  = fn(t) 

3=1  J J 


(9) 


Let  us  consider  the  transformation  of  the  left  side  of 

« n 


p ^2 

equation  (5).  Let  us  substitute  here  from  (IK  ns^  ~ 2 xf  ~ nx 

y i 

i-l 


n 


E{ns2  exp[  2 (itx.-x.)]}  = 
j-1  J J 


n 


= E { 2 x2  exp[  2 (itxlr~  x2 )]  } — E Inx2  exp[  2 ( itx  , - x2)  ] 
- 1 •’  ' K j=l  J J 


n 


n 


J-1  J k=3 
Me  make  f ur t he r the  following  t r an s f o r ma t i o n : 


n 


Efns2  exp  [ 2 (itx.  - x2  ) ] } = 
j=i  3 3 


1 ? p n n o n n 2 

= nr”1  (t  )E[x  exp  (itx  - x2)]  - — e{(  2 x.)  exp  [it  2 x.-  2 x.]} 

n j j=i  J j=i  j 


n 


n 


n 


2 

Let  us  evaluate  E [x2exp ( itx-x2 ) ] and  E{(  2 xj^exp[it  2 x . » 2 x'Tjl 


3=1 


j=i 3 j=i 


h 


E(x2eitx”x2)  = »f”(t) 

n 9 n 

e{(  21  x ) '"'exp  t it  21  x . - x';  j 

j-1  J j=l  J J=1  J 


~[rn(t)V 


It  follows  that  the  identity  (5)  may  be  rewritten  as  follows 
-nfn~1(t)f"(t)  + fn_1(t)f"(t)  + (n-l)fn'2(t)[f>(t)]2  = a fn(t) 


or 

fn_1(t)f,,(t)-fn"2(t)tf'(t)]2  ■=— axrri(t) , (ax  =■  ~I)  (11) 

p 

Clearly  f(t)  is  a continuous  function  and  f(0)  = J e"x  dF)  > Os 

therefore,  in  some  neighborhood  of  zero  f(t)  J-  0, 

Let  us  solve  equation  (11)  in  this  region*.  We  divide  both 

n 

sides  of  the  equation  by  f (t),  so  as  to  obtain 


f"(t) 

TTtT 


_rf 5 (t) 

Lnrr 


(12) 


orflog  f(t)]w  “ -a_  „ The  solution  of  this  equation  is 


Here 


f (t)  = k exp[itt-  t2] 

k = f(0)  = J e“x  dF(x)  *1 

2 

1 = j ,f » (0)  = J xe“x  dF(x) 


(13) 
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It  5 s easy  to  show  that  this  solution  may  be  extended  to  the 
entire  line.  We  shall  make  use  of  the  fact  that  the  set  of  zeros 
of  f(t)  is  closed.  Assuming  that  f(t)  does  have  zeros,  then  there 
exists  a value  t^  such  that  f(t^)  = 0,  while  for  all  values  of 

t for  which  [tj<|t  j,  f(t)  ^ 0,  Since  f(t)  is  the  solution  of 

° al  a 

the  equation  it  may  be  written  in  the  form  k exp[i/t-  -*r*t  ] „ 

Let,  for  instance  t^>0.  We  can  choose  an  e sufficiently  small, 

for  which 

f(tQ-e)  f 0, 

f(tQ-e)  = k exp[i^(t  - c)--^-(tQ-  e)  1 
From  this  it  follows  that  f(t~)  = lim  f(t  - e)  cannot  be  equal  to 

0 0 3^  2 

gero.  Wehave  thus  shown  that  the  solution  f(t)  = k exp[i/t~  2*”  t ] 
is  true  over  the  entire  line* 

Let  us  now  investigate  the  function  Q(x),  defined  as  follows  2 

x 2 • 

Q(x)  = J e”X  dF (x ) , ( lip ) 

“00 

Then  by  definition  f(t)  is  the  Fourier  transform  of  the  function 
fi(x)*  But  f(t)  is  the  characteristic  function  of  the  Gaussian  law,, 
and  therefore  S2(x)  may  be  represented  as  follows 

(x-r 

k f V '2*1  V dx  . 

</2Tca^  J -oo"  ■ 1 


£ (x) 


(15) 
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In  other  words,  we  may  define  the  function  F(x)  by  the  equation 

_ (x-?Q 

P e"x2dF(x)  = ~~rr  P e 2al  dx  • 

-co  Aai  -od 


(16) 


To  solve  this  equation,  let  us  note  that  for  arbitrary  x^  and  x 

x0  « Xo  - (x-/)2 

k , — - (i7) 


r:2  2 
J e x dP(x)  = 


, r 
JXi 


e 2al  dx  . 


We  shall  prove  that  F(x)  is  differentiable  at  every  point,  and 
we  shall  evaluate  its  derivative. 

Let  xQ  be  some  point,  for  example  x^>0,  and  let  h>0,  then 


xD+h  2 
j e“X  dF (x ) 


k 


x^+h 


/2-jia 


f 


e 


1 x. 


(x-r)2 
al  dx 


and  therefore 


. ,2.  XQ+h 

(x°+h)  j dF (x ) 


‘o 


xQ+h  2 txo+h 

< J e X dF(x)  < e X°  J dF(x).  (18) 


From  this  it  follows  that 


>/2n;ai 


-2  Xsb  - (x-y) 

e 2al  dx  < 


h 


F(x0+h)-F(x0) 

E ‘ 


k e 

< -^===  ““"TT 


(x„+h)2 


/2ita5 


J 


£19) 
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An  analogous  inequality  nay  be  obtained  for  h < 0,  and  we  thus  obtain 


(xo}  ~ 


exp[xQ  - 


UQ-r)2 

2a-j_ 


(20) 


The  &bove  theorem  may  be  somewhat  generalized  as  follows* 

Let  x^,  x^j  xn  be  mutually  independent  random  variables, 

identically  distributed  according  to  the  law  F(x),  Let  us  form  the 
statistics  x ~ °*zx2  + ‘ ° ,<ynxn  ^we  assu^e  that  all  are  non- 


negative , 


and 


that 


n 

2 oL 
k=l 


2 

k 


1) 


2 n 2 2 
and  s = Z xv  +,t,oi  x ) , 

k=l  K 1 1 n n 

»>v  2 

If  x and  s are  independent,  then  the  general  population  is 
normally  distributed. 

Proof » As  in  the  previous  theorem,  let  us  introduce  the  function 

f(t)  = |eltx-x2dF(x) 

Then  in  the  manner  utilized  in  the  previous  theorem,  we  obtain  the 
equation 

2 gnat*!  . L2  flhth  - * o*v*. 

jc=i  f(oikt)  k=X  1 J f(oijt) 

'The  solution  of  this  equation  yields  the  desired  answer. 
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